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ABSTRACT 


A  novel  test  has  been  developed  for  measuring  the  maximum  achievable 
calibration  performance  of  a  multi-channel  receiving  system.  The  test  may 
also  be  used  to  determine  the  quality  of  a  particular  calibration  scheme  and  to 
rank  the  relative  performance  of  several  calibration  schemes.  The  test  provides 
a  quantitive  measure  of  the  dynamic  range  of  the  multi-channel  receiver.  We 
demonstrate  the  utility  of  the  test  by  analysing  two  different  eight  channel 
receiver  systems. 
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Quantifying  Multi-channel  Receiver  Calibration 


EXECUTIVE  SUMMARY 

Many  high  frequency  radar  and  communications  systems  use  multi-channel  arrays  and 
receivers  with  digital  output  for  the  receiving  system.  This  approach  allows  multiple 
simultaneous  and  adaptive  optimal  beam  coverage  implemented  using  digital  beamforming 
and  where  each  beam  is  formed  by  a  weighted  linear  combination  of  the  output  of  the 
multi-channel  receiver. 

Digital  beamforming  will  work  correctly  provided  that  a  plane  wave  impinging  on  the 
array  remains  plane  following  digitisation  in  the  final  stage  of  the  receiver.  Implementation 
departures  firom  an  ideal  design  mean  that  the  plane  wave  requirement  will  not  be  achieved 
exactly  and  will  cause  degraded  beamformer  performance.  In  most  cases  the  receiver 
requires  explicit  calibration  to  correct  this  error  to  reach  some  desired  level  of  system 
performance. 

An  important  contributor  to  calibration  error  is  non-identity  between  individual  chan¬ 
nels  in  the  multi-channel  receiver.  Existing  techniques  for  calibrating  multi-channel  re¬ 
ceivers  are  based  on  introducing  a  training  or  calibration  signal  and  from  measurements 
of  this  signal  deriving  corrective  data  or  calibration  tables.  These  techniques  are  open 
loop.  There  is  no  explicit  assessment  of  the  performance  achieved  by  a  given  calibration 
table.  At  best  there  is  a  bad  data  check.  There  is  also  no  method  for  ranking  the  per¬ 
formance  of  two  candidate  calibration  tables  and  no  means  of  determining  just  how  well 
a  particular  calibration  scheme  can  improve  channel  homogeneity  given  inherent  receiver 
implementation  limitations. 

A  novel  test  has  been  developed  called  the  receiver  rejection  test  which  uses  an  injected 
noise  calibration  source  to  give  two  figures  of  merit  called  the  receiver  rejection  ratio  and 
the  plane  wave  rejection  ratio.  The  test  determines  the  maximum  attainable  calibration 
performance  of  a  given  multi-channel  receiver  system  and  indicates  how  well  a  particular 
calibration  scheme  performs  with  respect  to  this  maximum  and  to  other  potential  cali¬ 
bration  schemes.  The  injected  test  signal  used  to  conduct  the  receiver  rejection  test  may 
be  used  as  a  calibration  source.  The  maximum  attainable  calibration  performance  can 
be  used  as  a  design  specification  and  equipment  acceptance  metric  for  new  multi-channel 
receiver  systems.  It  gives  a  measure  of  the  attainable  dynamic  range  of  the  receiver  system 
but  does  not  require  that  the  receiver  system  be  already  calibrated  in  order  to  make  the 
measurement. 

The  receiver  rejection  test  has  been  applied  to  two  eight  channel  high  frequency  re¬ 
ceivers.  The  results  demonstrate  the  utility  of  the  test  and  how  it  might  be  applied  in 
actual  high  frequency  radar  and  communications  systems.  The  technique  and  a  wideband 
calibration  scheme  derived  from  the  technique  are  well  suited  for  incorporation  in  the  next 
generation  of  direct  digital  receiver  systems  based  on  analog  broadcast  band  and  local 
station  rejection  filters,  wideband  A/D  converters  and  digital  down  converters.  Several 
areas  are  identified  for  further  investigation. 
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Notation 


A/D 

analog  to  digital  converter 

DDC 

digital  down  converter 

DDRX 

Direct  digital  receiver 

DSTO 

Defence  Science  and  Technology  Organisation 

FIR 

finite  impulse  response 

HF 

high  frequency  (3-30  MHz) 

Hz 

Hertz 

IF 

intermediate  frequency 

KHz 

Kilohertz 

MVDR 

minimum  variance  distortionless  response 

MHz 

Megahertz 

ms 

milliseconds 

PC 

personal  computer 

RF 

radio  frequency 

Rx 

receiver 

s 

seconds 

SSD 

Surveillance  Systems  Division 

WJ 

Watkins  Johnson 
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1  Introduction 


This  report  considers  the  problem  of  quantifying  the  performance  of  array  calibration 
schemes  in  a  multi-channel  high  frequency  (HF)  radar  receiving  system.  The  results 
reported  here  are  also  applicable  to  HF  communications  receiving  systems  although  that 
is  not  our  motivating  application. 

Array  calibration  is  the  compensation  of  perturbations  from  ideal  and  known  propa¬ 
gation  delays  and  gains  in  individual  receiver  channels  in  a  multi-channel  receiving  array. 
These  propagation  delays  and  gains  are  measured  from  the  instant  a  free  space  electro¬ 
magnetic  wave  impinges  on  a  given  array  element  to  the  instant  the  information  contained 
in  the  electromagnetic  wave  is  digitised  in  an  analog  to  digital  (A/D)  converter  at  the 
output  of  the  receiver. 

Appropriately  accurate  array  calibration  (or  the  synonymic  expression  array  manifold 
identification)  is  required  for  classical  beamforming  to  ensure  beam  sidelobe  levels  are 
tolerably  low.  It  is  also  required  for  array  systems  using  adaptive  beamforming  to  en¬ 
sure  errors  in  knowledge  of  the  preserved  “look”  direction  do  not  result  in  desired  signal 
cancellation[l]. 

In  a  receiving  system  comprising  more  than  one  element,  the  following  components 
contribute  to  finite  propagation  delay  and  propagation  delay  and  gain  mismatch  between 
channels:  antenna  element  design  and  positioning,  element  earthing,  pre-amplifier,  pre¬ 
filter  and  matching  unit  design,  mutual  coupling  between  elements,  mutual  coupling  with 
other  nearby  conductors,  feeders,  feeder  matching,  receiver  pre-select  filters,  receiver  local 
oscillator  design,  receiver  intermediate  frequency  IF  design  and  A/D  conversion  timing. 

We  have  found  it  convenient  to  divide  such  sources  of  propagation  delay  and  gain 
error  into  two  categories.  First  are  those  which  have  approximately  constant  delay  and 
gain  error  between  channels  across  the  operating  bandwidth  of  the  radar.  We  call  this 
wideband  error.  Second  are  those  delay  and  gain  errors  which  vary  with  frequency  across 
the  bandwidth  of  the  radar  and  which  we  call  narrowband  error.  Both  wideband  and 
narrowband  error  may  vary  with  radar  carrier  frequency. 

Wideband  errors  can  be  minimised  by  enforcing  homogeneity  of  the  antenna  and  feeder 
layout.  For  example,  using  equal  length  feeders,  rigorous  attention  to  earthing  and  a  linear 
equi-spaced  array  including  passive  elements  either  within  or  beyond  the  array  end  to 
minimise  the  effect  of  mutual  coupling  inhomogeneity  between  elements.  Of  course  some 
wideband  error  will  remain  due  to  wideband  error  in  components  of  the  multi-channel 
receiver,  for  example,  differences  in  pre-select  filters  between  channels. 

Subject  to  these  design  guidelines,  the  major  source  of  error  is  wideband  and  nar¬ 
rowband  error  in  the  receiver,  which  is  generally  due  to  non-identity  between  the  IF  and 
pre-select  filters  of  different  channels.  Some  residual  wideband  error  remains  due  to  the 
array  and  feeder  system. 

In  practical  HF  radar  receivers  the  individual  channels  are  collocated  in  a  central 
equipment  shelter  and  so  the  sources  of  error  caused  by  the  receiver  are  together  in  one 
location.  This  simplifies  calibration  to  remove  these  errors  since  it  is  straightforward  to 
use  an  injected  source  in  the  equipment  shelter  rather  than  a  radiated  calibration  source 
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and  attempt  to  calibrate  both  the  antenna  array  and  the  receiver  in  the  presence  of  sources 
of  external  noise  and  interference. 

Existing  approaches  to  calibrating  HF  radar  arrays  such  as  used  in  the  Jindalee  skywave 
radar  [2]  typically  proceed  as  follows.  In  the  system  design  phase  the  wideband  errors  in  the 
antenna  and  feeder  are  minimised  by  the  design  and  layout  techniques  listed  previously. 
During  operations  the  radar  system  generates  “calibration  tables”  using  some  injected 
source  technique  and  a  specific  radar  calibration  mode  to  compensate  for  errors  within  the 
receiver.  There  are  checks  to  overall  calibration  using  radiated  sources  during  installation 
and  major  maintenance  phases.  In  these  calibration  schemes  the  calibration  tables  are 
constructed  using  an  open  loop  approach.  There  is  no  formal  check  on  the  “quality”  of 
the  generated  tables  as  part  of  the  calibration  process  except  for  a  rudimentary  bad  data 
test. 

There  are  many  techniques  described  in  the  literature  for  calibrating  arrays  for  the 
case  of  array  element  position  error,  for  example  [3]  and  the  references  therein.  More 
appropriate  for  HF  radar  is  a  technique  which  estimates  the  directions  of  arrival  of  radiated 
sources  in  the  presence  of  element  position  uncertainty,  channel  gain  and  phase  error  and 
element  mutual  coupling[4].  This  method  calibrates  the  array  as  part  of  estimating  the 
directions  of  arrival. 

These  techniques  are  mostly  iterative  and  use  externally  radiated  sources,  either  co¬ 
operatively  or  otherwise,  and  are  therefore  vulnerable  to  externally  radiated  interference 
during  calibration.  Importantly,  none  of  the  methods  provide  any  metric  for  quantifying 
the  performance  of  the  calibration  solution  they  generate  other  than  apparent  convergence 
of  the  iterative  calibration  algorithm. 

In  this  report  we  address  the  problem  of  determining  a  quality  measure  to  apply  when 
calibrating  multi-channel  receiver  systems.  A  new  technique  has  been  developed  which 
allows  one  to  determine  the  maximum  attainable  calibration  performance  and  whether  a 
particular  new  calibration  table  is  an  improvement  on  a  previous  calibration  table.  The 
technique  may  also  be  used  as  the  basis  of  a  scheme  to  generate  new  calibration  tables 
although  this  is  not  the  main  purpose.  In  related  work  [5]  the  authors  have  investigated  the 
achievable  performance  of  a  multi-channel  receiver  equalisation  filter  which  uses  circular 
convolution  to  implement  calibration  filters  in  a  computationally  efficient  manner. 


2  Multi-channel  receiver  specification  and 

calibration 

We  propose  a  new  test  called  the  receiver  rejection  test  which  uses  an  injected  noise 
calibration  source  to  give  two  figures  of  merit.  We  call  these  the  receiver  rejection  ratio 
and  the  plane  wave  rejection  ratio.  The  test  determines  the  maximum  attainable  calibra¬ 
tion  performance  of  a  particular  multi-channel  receiver  system  and  indicates  how  well  a 
particular  calibration  scheme  performs  with  respect  to  this  maximum. 

The  injected  test  signal  used  to  conduct  the  receiver  rejection  test  may  be  used  as  a 
calibration  source  itself,  although  other  sources  and  techniques  are  not  precluded.  For  ex- 
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ample,  in  an  existing  radar  a  calibration  scheme  may  already  be  in  place,  the  performance 
of  which  can  be  evaluated  using  the  receiver  rejection  test. 

We  further  propose  that  the  maximum  attainable  calibration  performance  can  be  used 
as  a  design  specification  and  equipment  acceptance  metric  for  new  multi-channel  receiver 
systems.  It  gives  a  measure  of  the  attainable  dynamic  range  of  the  receiver  system  but 
does  not  require  that  the  receiver  system  be  already  calibrated  in  order  to  make  the 
measurement.  This  way,  specification  and  testing  of  new  receiver  systems  can  be  separated 
firom  specification  and  testing  of  an  array  calibration  scheme. 


2.1  Receiver  rejection  test 

In  this  section  we  define  our  notation  and  present  the  receiver  rejection  test.  We  then 
detail  how  the  test  is  applied  in  practice  and  identify  important  properties  of  the  test, 
the  test  equipment  configuration  and  in  section  2.1.5  provide  interpretation  and  physical 
insight.  Finally,  we  provide  guidelines  for  selecting  how  many  array  snapshots  are  required 
to  produce  meaningful  results. 

2.1.1  Definitions 

We  use  the  notation  that  superscript  /  denotes  conjugation,  superscript  T  denotes 
transpose,  superscript  H  conjugate  transpose  and  E  the  expectation  operator. 

Consider  the  sampled  and  digitised  output  of  a  one  dimensional  equi-spaced  array  of 
M  antenna  elements.  Let  Xj  [xi^i, . .  .,XM,i]'^  be  the  snapshot  output  from  the  array, 
where  i  e  [1, . . . , iV]  for  in  total  N  snapshots.  Let  X  =  [xi, . . . , Xj, . . . ,  x^^]  be  called  the 
data  matrix.  The  covariance  matrix  is  defined  as  R  =  E[XX^]  while  in  practice  we  will 
use  an  estimated  covariance  matrix 

1  ^ 

R=;^^Xixf  (1) 

Generally,  the  receiver  rejection  test  evaluates  intermediate  results^  one  per  receiver 
channel.  We  index  these  by  A:  G  [1, ... ,  M], 

Define  the  receiver  steering  vector  for  the  channel  as  the  M  x  1  vector  with 
elements  ■  ■  ■ ,  . . . ,  and  where  ep,fc  =  0  for  p  yt  A:  and  Cp^k  =  1  for  p  = 

k.  For  example,  for  the  third  or  A:  =  3  channel  in  an  8  channel  receiver  system  63  = 
[0,0, 1,0, 0,0,0,  Of. 

Similarly  define  the  plane  wave  steering  vector  for  the  A*'’  channel  as  the  M  x  1 
vector  with  elements  . . . ,  dp,*, . . . ,  dM,kV  and  where  dp,*  =  for  p  #  A  and  dp,*  = 

-1  forp  =  A.  For  example,  for  the  A  =  3  channel  in  an  8  channel  receiver  system 

_  rl  i  i  1  i  1  ilT 

^3  —  L75  71  75  77  75  75  7J 

Also  define  the  calibration  weight  vector  c  as  the  M  x  1  vector  [ci, . . .  ,Cp, . . . ,  cm]^ 
where  for  convenience  and  without  loss  of  generality  ci  =  1  and  Cp  for  p  1  are  determined 
from  some  wideband  calibration  scheme.  We  note  that  this  a  very  simple  calibration  weight 
model.  The  calibration  matrix  is  defined  as  C  =  diag(c) 
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Let  w  be  the  M  x  1  vector  with  elements  [loi, . . . ,  Wp, . . . ,  wm]"^  called  the  beamformer 
weight  vector  or  more  concisely  the  weight  vector.  For  a  beamformer  yi  =  w^Xj  with 


output  power  E[|j/i  ■  y'|]  =  w^Rw  the  solution  to 

minfw^Rw] 

W 

(2) 

subject  to  the  unity  gain  in  direction  0  constraint 

t(0)^w  =  1 

(3) 

for  a  steering  vector  t(0)  is  given  by  the  well  known  minimum  variance  distortionless 
response  (MVDR)  beamformer  [6] 


R-H(g) 

t(0)^R-it(6>) 


(4) 


In  this  case  the  steering  vector  t(0)  is  of  the  form  . . .  ,t(0)A/]^  with  the  elements 

determined  by  the  array  manifold  and  the  desired  steer  direction  0.  A  classical  fixed 
beamformer  has  a  gain  of  M  assuming  we  ignore  loss  due  to  aperture  taper.  For  a  MVDR 
beamformer  the  gain  achieved  by  the  array  can  not  be  a  useful  performance  measure  since 
the  constraint  equation  (3)  enforces  this  gain  to  be  unity.  Instead,  the  signal  to  noise  power 
ratio  improvement  achieved  by  the  MVDR  beamformer  is  used  where  this  improvement 
ratio  is  defined  as 


G 


MVDR 


efR  ei 


(5) 


and  where  the  numerator  ef^R  ei  is  the  noise  output  power  in  the  first  array  channel  (i.e. 
a  channel  with  unity  gain)  and  the  denominator  wf^^R  Wppt  is  the  power  which  remains 
following  application  of  the  beamformer  with  weight  vector  .  Actually,  this  definition 
applies  regardless  of  the  choice  of  the  weight  vector.  However,  if  the  weight  vector  is 
selected  using  equation  (4)  and  using  the  true  covariance  R  and  if  the  signal  to  noise  ratio 
improvement  is  calculated  using  equation  (5)  and  the  true  covariance  then  the  signal  to 
noise  ratio  improvement  is  maximised.  We  note  that  Gmvdr  is  a  random  variable  with 
distribution  dependent  on  the  distribution  of  the  estimated  covariance  R.  We  expand  on 
this  in  section  2.1.6. 


The  receiver  rejection  test  is  defined  as  the  ratio 


(6) 


where  the  A:*’'  weight  vector  w„pt,,k  is  given  by  the  MVDR  formula  equation  (4) 


R 

efR-iefc 


(7) 


This  is  the  average  over  all  M  channels  of  the  ratio  of  the  power  in  the  channel 
(the  numerator  in  equation  (6))  to  the  power  remaining  in  that  channel  ^.RWppt^fc  (the 
denominator  in  (6))  following  application  of  the  optimum  beamformer  with  weight  vector 
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Wopt,fc.  In  this  case  the  optimum  weight  beamformer  removes  all  power  which  is  linearily 
correlated  between  receiver  channels. 


The  plane  wave  rejection  test  is  similarly  defined  as 


1  efRe, 


(8) 


This  is  the  average  over  all  M  channels  of  the  ratio  of  the  power  in  the  channel  e^^Refe 
to  the  power  remaining  in  that  channel  djk  following  application  of  a  beamformer  d;t 
which  only  rejects  power  arriving  from  boresight. 

When  calibration  weights  c  or  the  calibration  matrix  C  are  available,  then  rp„  is  given 
by  the  modified  form 

""  ^  h  dfCHRCdt 

To  permit  demonstration  of  the  proposed  calibration  performance  metric  we  have  used 
the  following  trivial  wideband  calibration  scheme  throughout  our  work 


,  N-\ 

r-  -  —  ^ 

^p-  N  2^  ^  _  . 


^  t=0  ^P’'' 


(10) 


2.1.2  Test  procedure 

The  receiver  rejection  test  proceeds  as  follows: 

1.  Inject  a  broadband  (with  respect  to  the  Rx  passband)  noise  source  through  matched 
amplitude  and  delay  paths  into  the  RF  input  of  each  receiver  channel  and  record 
digitised  receiver  output  data.  This  is  the  superposition  of  a  temporally  broadband 
spatially  rank  one  signal  and  the  internal  noise  of  each  receiver  channel  (rank  M 
assuming  internal  fioise  contributions  from  each  channel  are  uncorrelated) . 

2.  Vary  the  input  noise  source  power  level  from  below  the  internal  noise  of  the  receiver 
system  to  a  level  which  is  known  to  generate  power  in  the  output  caused  by  non¬ 
linearity  in  the  receiver  system.  This  may  be  caused  by  compression  or  saturation 
or  both  in  the  receiver  and  A/D  converter. 

3.  Record  receiver  output  data  (how  much  data  is  discussed  shortly)  for  each  of  a 
regular  set  of  input  noise  source  power  levels.  Determine  and  rp„  as  a  function 
of  the  input  noise  source  power  level. 

4.  The  maximum  indicates  the  maximum  rejectability  of  the  receiver  system  and  is 
a  measure  of  the  dynamic  range  of  the  multi-channel  receiver. 

5.  indicates  the  performance  of  the  current  calibration  scheme. 

6.  The  noise  signal  corresponding  to  the  level  which  achieved  maximum  Vrx  is  the 
appropriate  signal  to  use  for  generating  new  calibration  tables.  The  external  to 
internal  noise  power  ratio  of  this  noise  signal  is  greatest  without  being  compromised 
by  deleterious  effects  introduced  by  non-linearity  in  the  receiver. 
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2.1.3  Properties 

The  margin  between  and  gives  a  measure  of  the  quality  of  the  current  calibration 
scheme.  With  ideal  calibration  and  using  the  true  covariance  R 

J'pw  =  ’"rx  (11) 


For  and  derived  from  two  different  calibration  schemes  A  and  B  and  using  the 
true  covariance  R,  then  calibration  scheme  A  is  better  than  scheme  B  if 


and 


r 


A 

pw 


>  r 


B 

pw 


>  >  r® 

—  pw  pw 


(12) 

(13) 


In  practice  we  use  R  in  place  of  R  so  and  rp„  are  random  variables.  The  equality 
and  inequalities  listed  should  be  considered  in  relation  to  the  convergence  properties  of 
R  — ^  R. 


2.1.4  Test  equipment  configuration 

The  receiver  rejection  test  equipment  configuration  is  shown  in  figure  1.  The  bandpass 
filter  used  in  the  test  had  either  25KHz  or  200KHz  bandwidth  at  a  center  frequency  of 
10.7MHz.  Filtering  is  required  because  without  any  band  limiting  of  the  noise  source  it 
is  technically  difficult  to  implement  the  necessary  gain  so  as  to  drive  the  receiver  system 
with  enough  signal  to  cause  non-linear  behaviour.  We  selected  10.7MHz  as  the  test  carrier 
frequency  because  of  the  availability  of  the  two  bandpass  filters.  In  general,  one  or  several 
test  carrier  frequencies  should  be  examined.  The  second  amplifier  was  followed  by  an 
attenuator  with  120dB  range  in  steps  of  IdB.  Sufficient  data  snapshots  (N)  should  be 
collected  to  ensure  that  R  tolerably  approximates  R.  Guidelines  for  selecting  N  are 
presented  in  section  2.1.6. 

The  amplitude  gain  and  delay  through  the  8  way  splitter  and  the  cable  paths  from  the 
splitter  to  the  receiver  under  test  should  be  equal.  This  is  required  because  the  definition 
for  the  covariance  matrix  assumes  an  equally  spaced  array  and  the  receiver  rejection  test 
requires  that  the  noise  source  is  rank  one  and  arriving  from  boresight. 

This  is  not  a  significant  restriction.  Consider  a  practical  calibration  system  designed 
to  correct  calibration  errors  caused  by  equipment  within  the  receiver  system  shelter  and 
which  uses  our  approach  as  a  performance  metric.  In  this  case  the  noise  source  and 
splitter  equipment  will  also  be  collocated  with  the  receiver  hardware  in  the  equipment 
shelter.  Irrespective  of  the  actual  array  geometry  it  will  be  possible  to  treat  the  calibration 
measurements  as  though  the  array  is  linear  and  equi-spaced  with  arbitrary  inter-element 
spacing.  A  block  diagram  of  such  a  system  is  shown  in  figure  2. 

2.1.5  Interpretation  and  comments 


6 


The  ratios  and  rp„  are  the  average  across  all  channels  of  the  ratio  of  the  power  in 
one  receiver  channel,  the  “test”  or  channel,  to  the  power  removed  from  that  channel 
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EquI-length  cables 


Figure  1:  Receiver  rejection  test  laboratory  apparatus. 


M  channel  Rx 


Figure  2:  Equipment  configuration  for  a  practical  calibration  scheme. 
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using  a  linear  combination  of  the  signal  measured  in  the  remaining  channels.  All  channels 
are  combined  to  remove  that  part  of  the  signal  which  is  coherent  across  channels,  thereby 
reducing  the  power  in  the  test  channel. 

Each  channel  will  contain  some  noise  which  is  incoherent  with  respect  to  other  channels. 
The  dominant  contribution  is  from  individual  receiver  channel  internal  noise.  Incoherent 
noise  in  the  channel  can  not  be  removed  with  a  linear  combination  of  all  M  channels. 
With  no  external  signal  (or  test  noise  source)  applied,  the  covariance  R  will  be  full  rank 
and  have  approximately  equal  eigenvalues  and  0  and  0. 

If  the  input  signal  is  sufficiently  large  for  any  receiver  channel  to  generate  output  power 
due  to  non-linearity  effects  in  the  receiver  channels  then  a  linear  combination  of  receiver 
channels  will  no  longer  be  sufiicient  to  fully  reduce  the  power  in  the  test  channel.  In  this 
case  r„  and  Vp^,  will  be  reduced. 

For  the  plane  wave  rejection  test  the  channel  combining  weights  are  prescribed  such 
that  the  beamformer  will  only  remove  maximum  power  when  the  coherent  signal  is  arriving 
directly  from  boresight.  Any  channel  delay  deviations,  such  as  poor  calibration,  will  reduce 
the  rejection  ratio. 

For  the  receiver  rejection  test  the  beamformer  weight  vector  w^pt  ^  is  optimally  chosen 
to  minimise  the  total  output  power.  This  will  be  achieved  regardless  of  any  calibration 
error  given  the  choice  of  e*,  as  the  steering  vector.  Selection  of  as  the  steering  vector  is 
the  key  to  our  approach.  Minimum  total  output  power  can  be  achieved  with  zero  desired 
signal  cancellation,  without  requiring  that  the  array  be  already  calibrated. 

A  narrowband  receiver  rejection  test  r[f)^^  can  be  defined  by  constructing  R(/)  from 
channelised  snapshots  in  the  obvious  manner.  In  the  two  receivers  tested  so  far  we  have 
found  that  while  this  narrowband  extension  provides  insight  into  aspects  of  the  operation 
of  the  receivers  the  standard  and  less  complex  receiver  rejection  test  has  proven  sufficient 
as  a  performance  metric. 


2.1.6  Guidelines  for  selecting  the  number  of  snapshots  N 


In  section  2.1.1  it  was  explained  that  since  the  gain  of  a  MVDR  beamformer  is  con¬ 
strained  to  be  unity  the  array  gain  can  not  be  a  useful  performance  measure.  An  appropri¬ 
ate  measure  is  in  fact  the  signal  to  noise  ratio  improvement  achieved  by  the  application  of 
a  particular  weight  vector.  Maximum  signal  to  noise  ratio  improvement  is  achieved  when 
the  weight  vector  is  chosen  according  to  the  MVDR  design  formula  equation  (4) . 


The  MVDR  signal  to  noise  ratio  improvement  measure  for  the  case  of  a  known  covari¬ 
ance  R  is  the  deterministic  quantity  (?mvdr 


Gk 


ef^R  ei 


(14) 


which  is  the  ratio  of  the  power  in  one  channel  ef^Rei  to  the  power  w^^Rwopt  remaining 
following  application  of  the  beamformer.  In  practical  applications  R  is  unknown  and  one 
uses  the  estimated  covariance  R,  equation  (1)  and  repeated  here 


1  ^ 


x,x: 


H 


i=l 


(15) 
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which  is  formed  from  N  independent  snapshots  of  the  data.  In  this  case  Gmvdr  is  now  a 
random  variable  given  by  (repeated  from  equation  (5)) 


ef^Rei 


In  a  significant  contribution  Reed  et.  al.  [7]  showed  that 

G^MVDR  =  GmvDR  ■  p(R) 


(16) 


(17) 


where  p(R)  is  a  beta  function  distributed  random  variable  which  takes  on  values  between 
0  and  1  under  the  assumption  that  the  data  snapshots  used  to  construct  R  and  hence  Wopt 
in  equation  (4)  which  is  used  in  equation  (16)  are  independent  (i.e.  different)  of  the  data 
snapshots  used  to  construct  R  in  equation  (16). 

p(R)  has  mean  and  variance  [8]  given  by 


E[p(R)]  = 


N  +  2-M 
N  +  1 


(18) 


and 


E[p2(R)]  = 


{N  +  2-M){M  -1) 
(AT  +  l)2(iV  +  2) 


(19) 


respectively.  Note  that  the  expression  for  E[p^(R)]  given  in  [7]  is  incorrect.  Clearly  both 
E[p]  1  and  E[/9^]  0  as  the  number  of  snapshots  N  significantly  exceeds  M  in  which 

case  Gmvdr  well  approximates  Gmvdr- 


Both  the  receiver  rejection  ratio,  equation  (6),  and  the  plane  wave  rejection  ratio, 
equation  (8),  are  averages  formed  from  power  ratios  such  as  equation  (16)  and  so  we  can 
use  the  advice  contained  in  equation  (18)  and  equation  (19)  to  assist  our  selection  of  the 
required  number  of  snapshots  N  for  a  given  application.  Since  we  have  investigated  two 
eight  channel  (M  —  8)  receiver  systems  we  have  tabulated  values  of  E[p]  and  E[p^]  for 
various  N  in  table  1.  For  iV  =  160  =  20  ■  M  and  larger  the  expected  signal  to  noise  ratio 
loss  and  the  variance  of  this  loss  is  very  small  indeed. 

In  table  2  we  summarise  our  recommendations  for  choice  of  N  for  three  candidate 
applications  relevant  to  HF  radar  and  communications.  We  stress  that  the  rate  at  which 
independent  snapshots  may  be  collected  is  determined  by  the  post  receiver  bandwidth 
of  the  test  noise  source  and  not  the  sampling  rate  of  the  acquisition  system.  For  the 
system  bandwidths  typically  used  in  HF  radar  and  communications  systems  table  2  shows 
that  the  selection  of  the  number  of  snapshots  according  to  the  comparatively  conservative 
criteria  ^  >  100  produces  snapshot  integration  intervals  which  are  appropriate  for  these 
applications.  Prom  table  1  we  see  that  for  our  recommended  selection  the  expected  value 
of  the  signal  to  noise  ratio  loss  with  respect  to  the  true  value  of  the  signal  to  noise  ratio 
is  0.04dB  and  that  the  variance  of  this  loss  is  approximately  10  ®  times  the  true  value  of 
the  signal  to  noise  ratio. 

In  the  narrowband  receiver  rejection  test  r(/)„  the  estimated  covariance  R(/)  is  gen¬ 
erated  from  channelised  snapshots  output  from  some  digital  filter  bank.  If  the  bandwidth 
of  each  filter  in  the  filter  bank  is  then  the  rate  at  which  independent  snapshots  are  gen¬ 
erated  is  determined  by  this  bandwidth  and  not  the  original  noise  source  bandwidth  Bns. 
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N 

E(p) 

E[p^]  (-10-^) 

-10-log[E[p]]  (dB) 

9 

0.3000 

19.0909 

5.2288 

16 

0.5882 

13.4564 

2.3045 

40 

0.8293 

3.3710 

0.8130 

80 

0.9136 

0.9628 

0.3925 

160 

0.9565 

0.2567 

0.1931 

320 

0.9782 

0.0662 

0.0958 

800 

0.9913 

0.0108 

0.0381 

1600 

0.9956 

0.0027 

0.0190 

4000 

0.9983 

0.0004 

0.0076 

8000 

0.9991 

0.0001 

0.0038 

40000 

0.9998 

0.0000 

0.0008 

102400 

0.9999 

0.0000 

0.0003 

Table  1:  Mean  and  variance  of  p  and  expected  signal  to  noise  ratio  loss  in  dB  for  various 
values  of  N  for  the  case  of  M  =  8. 


B^s  (KHz) 

(KHz) 

mm 

AT  for  M  =  8 

Ti  (ms) 

3.4 

>3.4 

100 

235 

10 

100 

80 

100 

100 

800 

8 

Table  2:  Recommended  selections  for  N  for  three  typical  HF  radar  and  communications 
scenarios.  is  the  bandwidth  of  the  test  noise  source,  fs  is  the  complex  sampling 

frequency.  T,  is  the  recommended  integration  interval  for  the  eight  channel  case  (where 
M^8). 


In  general  >  Bf^^  and  consequently  the  narrowband  receiver  rejection  test  requires 
significantly  more  (x^^)  snapshots  than  the  receiver  rejection  test.  This  may  mean  that 

our  guideline  of  ^  >  100  may  need  to  be  relaxed  and  specific  values  for  N  investigated 
for  expected  value  of  loss  and  variance  of  loss. 


3  Results 


We  have  applied  the  receiver  rejection  test  to  two  8  channel  HF  receiver  systems.  In 
this  section  we  provide  details  of  the  two  receivers  tested,  present  the  results  obtained, 
provide  an  interpretation  of  these  results  and  demonstrate  the  influence  of  varying  the 
number  of  snapshots  N  used  to  form  the  estimated  covariance  matrix. 
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Figure  3:  DDRX  block  diagram. 


3.1  Receiver  details 

3.1.1  DDRX 

DDRX  is  an  8  channel  direct  digital  receiver  developed  by  Communications  Division 
DSTO  using  Analog  Devices  and  Graychip  evaluation  modules.  It  uses  8  x  65MHz  12bit 
A/D  +  2  X  4  ch.  Graychip  digital  down  converters.  There  are  lowpass  filters  with  cut¬ 
off  at  20MHz  and  30dB  gain  amplifiers  on  the  input  of  each  channel.  Output  data  is 
recorded  and  the  receiver  controlled  using  a  PC.  A  block  diagram  is  shown  in  figure  3. 
The  DDRX  output  bandwidth  was  selected  to  be  lOKHz  at  a  sampling  rate  (complex) 
of  lOKHz.  The  coherent  measurement  interval  was  5s.  Calibration  involved  determining 
one  complex  weight  per  channel.  Calibration  weights  were  determined  from  the  data  set 
which  indicated  the  highest  receiver  rejection  ratio. 


3.1.2  WJ9010 


The  WJ9010  is  an  8  channel  HF  direction-finding  system  manufactured  by  Watkins- 
Johnson.  Each  receiver  channel  uses  an  analog  IF  strip,  with  bandwidth  16KHz.  Baseband 
conversion  and  filtering  and  conversion  to  digital  samples  is  implemented  using  a  built-in 
16  bit  A/D  and  digital  signal  processor  chip.  The  WJ9010  output  bandwidth  was  selected 
to  be  10.4KHz  at  a  sampling  rate  of  25KHz  (complex).  The  coherent  measurement  interval 
was  5s.  The  WJ9010  has  an  internal  self  calibration  scheme.  Immediately  prior  to  and 
then  immediately  following  a  coherent  measurement  the  WJ9010  internally  determines  pre 
and  post  calibration  weights  which  may  be  applied  to  the  measured  data,  or  not,  at  the 
operators  discretion. 
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3.2  Experimental  results 

3.2.1  DDRX 

The  rejection  ratios  versus  noise  input  power  level  for  the  DDRX  are  shown  in  figures  5 
and  6  for  noise  source  bandwidths  of  25KHz  and  200KHz  respectively.  Each  figure  shows 

and  then  for  the  case  of  no  calibration  and  following  calibration. 

Figures  7  through  14  show  beampatterns  for  varying  input  noise  power  levels  computed 
for  both  the  calibrated  and  uncalibrated  data  sets.  The  beam  patterns  show  beamformed 
power  versus  angle  of  arrival  and  have  been  evaluated  on  an  angle  interval  of  [—90,90] 
degrees  in  0.1  degree  increments.  The  beampatterns  have  all  been  formed  using  a  50dB 
Taylor  window. 

We  repeated  the  beampattern  calculations  with  an  80dB  Taylor  window.  This  allowed 
extraction  of  the  beam  peak  to  maximum  sidelobe  level  ratio  without  the  result  saturating 
at  the  equi-ripple  sidelobe  level  of  the  50dB  Taylor  window.  Figure  15  shows  the  beam 
peak  to  maximum  sidelobe  level  ratio  for  the  calibrated  and  uncalibrated  cases.  This  data 
was  collected  using  the  25KHz  filter. 

Figures  16  and  17  show  the  uncalibrated  and  calibrated  receiver  channel  gain  transfer 
function  for  the  DDRX  computed  with  respect  to  channel  1.  Gain  difference  between 
channels  have  reduced  to  below  O.ldB.  Similarly  figures  18  and  19  show  the  uncalibrated 
and  calibrated  receiver  channel  phase  transfer  function  and  in  this  case  the  inter-channel 
phase  differences  are  less  than  0.2  degrees.  Following  calibration  the  receiver  channels  are 
close  to  identical. 


3.2.2  WJ9010 

The  rejection  ratios  versus  noise  input  power  level  for  the  WJ9010  is  shown  in  figures  20 
and  21  for  noise  source  bandwidths  of  25KHz  and  200KHz  respectively.  Each  figure 
shows  and  then  for  the  case  of  no  calibration  (or  uncalibrated),  the  WJ  pre  and 
post  calibration  (in  subsequent  investigations  we  used  pre-calibrated  only)  and  finally 
re-calibration  where  the  simple  wideband  calibration  scheme  is  applied. 

Figures  22  through  30  show  beampatterns  for  varying  input  noise  power  levels  com¬ 
puted  for  the  uncalibrated,  the  pre-calibrated  and  the  re-calibrated  data  sets.  The  beam 
patterns  show  beamformed  power  versus  angle  of  arrival  and  have  been  evaluated  on  an 
angle  interval  of  [—90,90]  degrees  in  0.1  degree  increments.  The  beampatterns  have  all 
been  formed  using  a  50dB  Taylor  window. 

Again  we  repeated  the  beampattern  calculations  with  an  80dB  Taylor  window  to  give 
the  beam  peak  to  maximum  sidelobe  level  ratio.  Figure  31  shows  this  ratio  for  the  uncal¬ 
ibrated,  the  pre-calibrated  and  the  re-calibrated  cases  collected  using  the  25KHz  filter. 

Figures  32  and  33  show  the  pre-calibrated  and  re-calibrated  receiver  channel  gain 
transfer  function  for  the  WJ9010  computed  with  respect  to  channel  1.  Average  gain  dif¬ 
ference  between  channels  has  reduced.  Similarly  figures  34  and  35  show  the  pre-calibrated 
and  re-calibrated  receiver  channel  phase  transfer  function  and  in  this  case  the  average 
inter-channel  phase  differences  are  also  reduced.  Significant  narrowband  gain  and  phase 
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non-identity  between  channels  remains  and  this  causes  the  significant  margin  between  the 
re-calibrated  plane  wave  rejection  ratio  and  the  receiver  rejection  ratio  shown  in  figure  20. 


3.3  Interpretation 

The  DDRX  performs  poorly  without  calibration.  It  contains  a  wideband  error  due  to 
delay  and  amplitude  mismatch  in  the  individual  channel  amplifier  and  lowpass  filter  sets, 
and  possibly  errors  in  the  8- way  splitter. 

If  the  latter  is  the  case  then  this  is  a  test  measurement  instrument  error.  We  rec¬ 
ommend  that  resistive  power  splitters  should  be  used  in  the  test  equipment  instead  of 
transformer  based  devices.  While  having  greater  attenuation  resistive  power  splitters  can 
be  constructed  with  very  accurate  gain  and  delay  matching  between  channels  compared 
with  transformer  based  units. 

The  DDRX  beam  sidelobe  levels  decreased  following  calibration  by  up  to  40dB  (see 
figure  15).  This  is  a  substantial  improvement  which  diminishes  once  the  receiver  is  over¬ 
driven  into  its  non-linear  operating  region. 

The  calibration  error  is  a  broadband  effect,  since  simple  8  complex  number  calibration 
has  improved  calibration  such  that  rp^  is  close  to  r„-  This  is  because  the  frequency 
selective  filters  in  the  DDRX  are  well  matched  digital  linear  phase  FIR  filters  in  the  DDC. 

The  bandwidth  of  the  noise  source  was  selected  to  be  either  200KHz  or  25KHz  by 
selecting  an  appropriate  filter  at  a  center  frequency  of  10.7MHz.  Both  are  greater  than  the 
WJ9010  IF  bandwidth  and  so  made  little  difference  to  the  measurements  with  this  receiver. 
The  DDRX  has  no  narrowband  analog  selectivity  in  front  of  the  A/D  converters  and  the 
200KHz  bandwidth  noise  source  reduced  the  effective  dynamic  range  of  the  receiver  by 
approximately  lOdB  compared  to  the  25KHz  bandwidth  case.  The  dominant  non-linearity 
in  the  DDRX  is  amplitude  clipping  in  the  A/D  converters.  The  200KHz  noise  source  will 
produce  a  peak  amplitude  approximately  lOdB  ^  larger  than  the  peak  amplitude  of  the 
25KHz  noise  source  when  each  is  observed  for  the  same  measurement  interval. 

The  dynamic  range  of  the  DDRX  is  significantly  effected  by  the  large  signal  out-of- 
band  HF  environment.  A  practically  useful  direct  digital  receiver  system  will  require 
analog  front  end  filters  for  broadcast  and  local  station  rejection.  Non-identity  between 
the  filters  of  different  receiver  channels  will  be  a  source  of  wideband  calibration  error. 
Since  the  receiver  and  the  analog  front  end  filters  can  be  expected  to  be  collocated  in  an 
equipment  shelter  the  technique  based  on  using  an  injected  calibration  source  developed 
here  will  be  able  to  fully  calibrate  the  receiver  system. 

The  dynamic  range  limiting  mechanisms  of  the  DDRX  and  the  WJ9010  are  different 
and  the  WJ9010  is  less  sensitive  to  the  external  large  signal  environment. 

The  WJ9010  is  effectively  useless  without  at  least  applying  either  the  in-built  pre  or 
post  measurement  calibration  weights.  There  is  little  difference  between  the  performance 
of  the  pre  or  the  post  measurement  weights.  However,  both  can  be  improved  by  further 
simple  8  complex  number  calibration,  which  gives  an  approximately  5dB  reduction  in 
beam  sidelobes  (see  figure  31). 

Hoiog^ 
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Further  improvement  again  is  possible  since  ^  is  often  greater  than  lOdB.  The  indi¬ 
vidual  receiver  channel  transfer  functions  (measured  with  respect  to  channel  1)  show  that 
the  remaining  calibration  error  is  a  function  of  passband  frequency.  Further  calibration 
improvement  will  require  frequency  (within  the  passband)  selective  calibration.  More  so¬ 
phisticated  calibration  schemes  using  a  finite  impulse  response  (FIR)  filter  structure  are 
possible.  Determination  of  FIR  equaliser  weights  is  non-trivial.  Simple  frequency  domain 
(receiver  passband)  point  constraints,  say  on  a  regular  discrete  grid  of  frequencies,  pro¬ 
duce  poor  results  due  to  unconstrained  behaviour  of  the  equaliser  between  the  points  in 
the  discrete  frequency  grid.  See  [5]  for  consideration  of  this  problem  assuming  calibration 
filters  implemented  using  circular  convolution. 


3.4  Effect  of  number  of  snapshots  N 

The  influence  of  the  number  of  snapshots  used  to  form  the  estimated  covariance  R  is 
shown  in  figures  36  through  41.  The  receiver  rejection  test  was  repeated  using  the  DDRX 
data  for  the  case  of  the  following  set  of  numbers  of  snapshots 

N  e  {9, 16, 40, 80, 160, 320, 800, 1600, 4000, 8000, 40000, 102400}  (20) 

which,  for  M  =  8  receiver  channels,  correspond  to  the  following  multiples  of  M 
N 

—  e  {1  +  1, 2, 5, 10, 20, 40, 100, 200, 500, 1000,  5000, 12800}  (21) 

The  expected  penalty  associated  with  these  choices  for  N  is  shown  in  table  1.  By  N  = 
800  the  results  are  indistinguishable  from  the  N  =  102400  case.  In  our  experiment  we 
have  violated  the  assumption  that  the  data  snapshots  used  to  determine  the  optimum 
weight  vector  are  independent  from  the  data  snapshots  used  to  construct  the  estimated 
covariance  matrix  which  is  in  turn  used  to  determine  the  signal  to  noise  power  ratio. 
This  certainly  effects  the  small  N  cases  but  does  not  invalidate  the  number  of  snapshot 
selection  guidelines  proposed  earlier.  Clearly  convergence  has  been  achieved  according  to 
our  guidelines. 


4  Future  work 

The  results  of  our  experiments  demonstrate  that  the  receiver  rejection  test  is  useful 
for  specifying  and  calibrating  multi-channel  receivers.  Areas  identified  for  future  work 
include: 

1.  Develop  a  narrowband  calibration  scheme  for  the  WJ9010.  The  goal  is  to  achieve 

close  to  for  the  WJ9010  and  so  reduce  narrowband  (passband)  errors. 

2.  Investigate  the  influence  of  M  on  and  It  is  expected  that  both  will  decrease 
as  M  -^2  and  the  MVDR  beamformer  “uses  up”  the  M  available  degrees  of  freedom 
rejecting  the  uncalibrated  and  hence  non-rank  one  test  source. 
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Figure  4'  Block  diagram  of  a  narrowband  direct  RF  noise  source  suitable  for  a  radiated 
receiver  rejection  test. 


3.  Investigate  the  related  performance  dependence  of  for  the  case  of  P  >  1  uncorre¬ 
lated  test  sources  arriving  from  different  angles  as  P  ^  M.  It  is  expected  that  this 
will  show  the  receiver  rejection  test  should  be  extended  to  indicate  reduced  receiver 
performance  for  systems  designed  to  operate  in  the  presence  of  multiple  interference 
sources  where  the  number  of  sources  P  — >  M. 

4.  Develop  a  noise  source  generator  suitable  for  external  radiation  tests.  This  requires 
sufficient  output  power  and  accurate  bandwidth  control.  One  possible  design  is 
outlined  in  figure  4. 


5  Conclusions 


We  have  developed  a  test  for  measuring  both  the  maximum  achievable  calibration 
performance  and  the  dynamic  range  of  a  multi-channel  receiving  system.  The  test  can 
also  be  used  to  determine  the  quality  of  a  particular  calibration  scheme.  The  technique 
has  been  successfully  applied  to  two  8  channel  receiving  systems. 

The  technique  and  a  simple  wideband  error  calibration  scheme  derived  from  the  tech¬ 
nique  are  well  suited  for  incorporation  in  the  next  generation  of  direct  digital  receiver 
systems  based  on  analog  broadcast  band  and  local  station  rejection  filters,  wideband  A/D 
converters  and  digital  down  converters. 
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Receiver  rejection  test:  Noise  BW=25KHz:  Cal=calf200att25.mat 


noise  source  level  with  respect  to  ref  (dB) 


Figure  5:  DDRX.  (0)  receiver  rejection  ratio.  (+)  uncalibrated  plane  wave  rejection  ratio. 
(J.)  calibrated  plane  wave  rejection  ratio.  Noise  source  bandwidth  25KHz. 


Receiver  rejection  test;  Noise  BW=200KHz:  Cai=calf25att15.mat 


noise  source  level  with  respect  to  ref  (dB) 


Figure  6:  DDRX.  (Q)  receiver  rejection  ratio.  (+)  uncalibrated  plane  wave  rejection  ratio. 
(X)  calibrated  plane  wave  rejection  ratio.  Noise  source  bandwidth  200KHz. 
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Figure  7;  DDRX  beampattern.  Noise  source  input  level  (left)  ref-90dB  (right)  ref-SOdB. 
Noise  source  bandwidth  25KHz.  (-)  calibrated.  (—)  uncalibrated. 


Figure  8:  DDRX  beampattern.  Noise  source  input  level  (left)  ref-70dB  (right)  ref-60dB. 
Noise  source  bandwidth  25KHz.  (- )  calibrated.  ( — )  uncalibrated. 


Figure  9:  DDRX  beampattern.  Noise  source  input  level  (left)  ref-SOdB  (right)  ref-45dB. 
Noise  source  bandwidth  25KHz.  (- )  calibrated.  (— )  uncalibrated. 
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BMinpattom  of  CddffZSatMO.ttat  v»ilh  (-)  and  wHhout  (— )  caMbratton  Beampenem  of  Cddrf25att3S  dat  with  (-)  and  wllhotit  (~)  calibfaBon 


Figure  10:  DDRX  beampattern.  Noise  source  input  level  (left)  ref-fOdB  (right)  ref-35dB. 
Noise  source  bandwidth  25KHz.  (-)  calibrated.  ( — )  uncalibrated. 


B^itTvatlam  of  CddffSSatOO.dat  w«h  (-)  wid  wfftout  (— )  eaUbralton  Boampattem  of  Cddrf25aB25.dat  with  (-)  and  without  (~)  calibratton 


Figure  11:  DDRX  beampattern.  Noise  source  input  level  (left)  ref-30dB  (right)  ref-25dB. 
Noise  source  bandwidth  25KHz.  (-)  calibrated.  ( — )  uncalibrated. 


Beampatteff)  of  Cddrf25an20  dat  w«h  {-)  and  wWtoot  (— )  caHbmtton  Beampanem  of  Cddrf25att1 5  dat  with  (-)  and  without  (— )  caKbrnlton 


Figure  12:  DDRX  beampattern.  Noise  source  input  level  (left)  ref-20dB  (right)  ref-15dB. 
Noise  source  bandwidth  25KHz.  (-)  calibrated.  ( — )  uncalibrated. 
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Figure  13:  DDRX  beampattern.  Noise  source  input  level  (left)  ref-lOdB  (right)  ref-05dB. 
Noise  source  bandwidth  25KHz.  (- )  calibrated.  (— )  uncalibrated. 


Figure  14:  DDRX  beampattern.  Noise  source  input  level  ref-OdB.  Noise  source  bandwidth 
25KHz.  (-)  calibrated.  ( — )  uncalibrated. 
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Peak  to  sidelobe  ratio:  Noise  BW=25KHz:  Cal=Ccldff25att1 5.dat 


noise  source  level  with  respect  to  ref  (dB) 

Figure  15:  DDRX  beam  peak  to  maximum  sidelobe  level  ratio  for  the  ('x)  calibrated  and 
(+)  uncalibrated  cases. 


Transfer  function:  |H| 


Figure  16:  DDRX  channel  transfer  functions  (gain)  (baseband  freq.  v.  dB)  for  the  uncal¬ 
ibrated  case.  Multiple  lines  are  individual  channels. 
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Transfer  function:  |H|  (cal) 


Figure  17:  DDRX  channel  transfer  functions  (gain)  (baseband  freq.  v.  dB)  for  the  cal¬ 
ibrated  case.  Multiple  lines  are  individual  channels.  Individual  channel  responses  are 
superimposed. 


Transfer  function:  <H 


Figure  18:  DDRX  channel  transfer  functions  (phase)  (baseband  freq.  v.  deg.)  for  the 
uncalibrated  case.  Multiple  lines  are  individual  channels. 
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Transfer  function:  <H  (cal) 


frequency  (KHz) 

Figure  19:  DDRX  channel  transfer  functions  (phase)  (baseband  freq.  v.  deg.)  for  the 
calibrated  case.  Multiple  lines  are  individual  channels.  Individual  channel  responses  are 
superimposed. 
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Receiver  rejection  test:  Noise  BW=25KHz 


noise  source  level  with  respect  to  ref  (dB) 


Figure  20:  WJ9010  (Q)  receiver  rejection  ratio.  (+)  uncalibrated  plane  wave  rejection 
ratio,  (box)  calibrated  (WJ-pre)  plane  wave  rejection  ratio,  fciiamondj  calibrated  (WJ- 
post)  plane  wave  rejection  ratio.  (X)  re-calibrated  plane  wave  rejection  ratio.  Noise  source 
bandwidth  25KHz. 


Receiver  rejection  test:  Noise  BW=200KHz 


noise  source  level  with  respect  to  ref  (dB) 


Figure  21:  WJ9010  (U)  receiver  rejection  ratio.  (+)  uncalibrated  plane  wave  rejection 
ratio,  (box)  calibrated  (WJ-pre)  plane  wave  rejection  ratio,  ((iiainondj  calibrated  (WJ- 
post)  plane  wave  rejection  ratio.  (X)  re-calibrated  plane  wave  rejection  ratio.  Noise  source 
bandwidth  200KHz. 
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Figure  22:  WJ9010  beampattem.  Noise  source  input  level  (left)  ref-120dB  (right)  ref- 
llOdB.  Noise  source  bandwidth  25KHz.  (-.)  uncalibrated.  ( — )  calibrated  (WJ-pre).  (-) 
re- calibrated. 


B^ampaSwn  of  w4M10l02SPatt100.dat  wHtfi  M  (-),  pi«  (— }  and  no  (-.)  caHbmtion  Baampattem  of  «r)dO  tOK)26Pan090.<lat  w4th  lul  (-),  pra  (— )  and  no  (-.)  caRbratton 


angla  of  arrWat  (deg)  angle  of  arrival  (deg) 


Figure  23:  WJ9010  beampattem.  Noise  source  input  level  (left)  ref-lOOdB  (right)  ref- 
90dB.  Noise  source  bandwidth  25KHz.  (-.)  uncalibrated.  ( — )  calibrated  (WJ-pre).  (-) 
re-calibrated. 


Figure  24-'  WJ9010  beampattem.  Noise  source  input  level  (left)  ref-80dB  (right)  ref-70dB. 
Noise  source  bandwidth  25KHz.  (-.)  uncalibrated.  ( — )  calibrated  (WJ-pre).  (-)  re¬ 
calibrated. 
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Figure  25:  WJ9010  beampattern.  Noise  source  input  level  (left)  ref-60dB  (right)  ref-50dB. 
Noise  source  bandwidth  25KHz.  (-.)  uncalibrated.  (—)  calibrated  (WJ-pre).  (-)  re¬ 
calibrated. 


Figure  26:  WJ9010  beampattern.  Noise  source  input  level  (left)  ref-45dB  (right)  ref-40dB. 
Noise  source  bandwidth  25KHz.  (-.)  uncalibrated.  (—)  calibrated  (WJ-pre).  (-)  re¬ 
calibrated. 


Figure  27:  WJ9010  beampattern.  Noise  source  input  level  (left)  ref-35dB  (right)  ref-SOdB. 
Noise  source  bandwidth  25KHz.  (-.)  uncalibrated.  (—)  calibrated  (WJ-pre).  (-)  re¬ 
calibrated. 
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B«am(>anBmolwj9010f025Pan02S.da(wllh  tijll(-).  pt9( — )  and  no  (-.)  caHbnilton 


Beampattem  o(  wj9010f025Patt020.dat  wltti  full  (-),  pre  ( — )  and  no  (-.)  calibration 


Figure  28:  WJ9010  beampattern.  Noise  source  input  level  (left)  ref-25dB  (right)  ref-20dB. 
Noise  source  bandwidth  25KHz.  (-.)  uncalibrated.  ( — )  calibrated  (WJ-pre).  (-)  re¬ 
calibrated. 


Beampattern  of  ««|9010fD25PaH0tO.d8t  wl0i  M  (-),  pie  (— )  and  no  (-.)  caNbiatlon 


Figure  29:  WJ9010  beampattern.  Noise  source  input  level  (left)  ref-15dB  (right)  ref-lOdB. 
Noise  source  bandwidth  25KHz.  (-.)  uncalibrated.  ( — )  calibrated  (WJ-pre).  (-)  re¬ 
calibrated. 


Figure  30:  WJ9010  beampattern. 
Noise  source  bandwidth  25KHz. 
calibrated. 


Noise  source  input  level  (left)  ref-5dB  (right)  ref-OdB. 
(-.)  uncalibrated.  ( — )  calibrated  (WJ-pre).  (-)  re- 
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Peak  to  sidelobe  ratio:  Noise  BW=25KHz:  Cal=calwjf25patt25.mat 


noise  source  level  with  respect  to  ref  (dB) 


Figure  31:  WJ9010  beam  peak  to  maximum  sidelobe  level  ratio  for  the  (n)  re- calibrated, 
(+)  calibrated  (WJ-pre)  and  (box)  uncalibrated  cases. 


Figure  32:  WJ9010  channel  transfer  functions  (gain)  (baseband  freq.  v.  dB)  for  the 
pre- calibrated  case.  Multiple  lines  are  individual  channels. 
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Transfer  function:  |H1  (cal) 


Figure  33:  WJ9010  channel  transfer  functions  (gain)  (baseband  freq.  v. 
re-calibrated  case.  Multiple  lines  are  individual  channels. 


frequency  (KHz) 

Figure  34:  WJ9010  channel  transfer  functions  (phase)  (baseband  freq.  v. 
pre- calibrated  case.  Multiple  lines  are  individual  channels. 


dB)  for  the 


deg.)  for  the 
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Transfer  function;  <H  (cal) 


frequency  (KHz) 

Figure  35:  WJ9010  channel  transfer  functions  (phase)  (baseband  freq.  v.  deg.)  for  the 
re-calibrated  case.  Multiple  lines  are  individual  channels. 
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••n^MhcM  nctoaiMiicalMMtiPupKtlDnMde):  18*M(Mtwto 

Figure  36:  DDRX.  (0)  receiver  rejection  ratio.  (+)  uncalibrated  plane  wave  rejection  ratio, 
(m)  calibrated  plane  wave  rejection  ratio.  Noise  source  bandwidth  25KHz.  The  number  of 
snapshots  used  to  construct  R  is  5  (Isft)  and  16  (right). 


Figure  37:  DDRX.  (Q)  receiver  rejection  ratio.  (+)  uncalibrated  plane  wave  rejection  ratio. 
(X)  calibrated  plane  wave  rejection  ratio.  Noise  source  bandwidth  25KHz.  The  number  of 
snapshots  used  to  construct  R  is  40  (left)  and  80  (right). 


ito»*»ourc*««v*fwHhrMp«rttei»f(dB):  leOimpiho*  notoi*«?ore*tov«l¥ri<hf»ipMltor»l{tt^:  320  jnapthoti 

Figure  38:  DDRX.  (Q)  receiver  rejection  ratio.  (+)  uncalibrated  plane  wave  rejection  ratio. 
(X)  calibrated  plane  wave  rejection  ratio.  Noise  source  bandwidth  25KHz.  The  number  of 
snapshots  used  to  construct  R  is  160  (left)  and  320  (right). 
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Figure  39:  DDRX.  (Q)  receiver  rejection  ratio.  (+)  uncalibrated  plane  wave  rejection  ratio. 
(J.)  calibrated  plane  wave  rejection  ratio.  Noise  source  bandwidth  25KHz.  The  number  of 
snapshots  used  to  construct  R  is  800  (left)  and  1600  (right).  800  is  our  recommended 
number  of  snapshots  when  testing  the  DDRX. 


Figure  40:  DDRX.  (Q)  receiver  rejection  ratio.  (+)  uncalibrated  plane  wave  rejection  ratio. 
(X)  calibrated  plane  wave  rejeetion  ratio.  Noise  source  bandwidth  25KHz.  The  number  of 
snapshots  used  to  construct  R  is  4000  (left)  and  8000  (right). 


Figure  41:  DDRX.  (0)  receiver  rejection  ratio.  (+)  uncalibrated  plane  wave  rejection  ratio. 
(X)  calibrated  plane  wave  rejection  ratio.  Noise  source  bandwidth  25KHz.  The  number  of 
snapshots  used  to  construct  R  is  40000  (left)  and  102400  (right). 
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